DOCOMBHT BESOBE 



£D 201 26H 



HE 313 7 



AOTHOB 
TI2LE 

PDB DATE 
NOTE 



EDBS PRICE 
DESCRIPTORS 



ttie 



IDENTIFIERS 



"Bosst Barbara o. 

Perceived Dimensions of Hiirsing practice; 
analytic stndy Osing Nurse Educators. 
Apr B1 

42p.^ Paper presented at the Annual Me.itia? c 
Aaerican Educational Research Associet .on (L- 
Angeles, CA, April 13-17, 19B1) . 

liFBl/PC02 Plus Postage. 

college Faculty; *2valuation criteria; *Fa3tor 
Analysis; -Higher Education; ♦Job Afialj -i^; ao- 
P.erforaance; Job Skills; Measurement Ir^n.va^ ? 
Burses; * Nursing: Nursing Education; P rr: itr^ al 
Development;, *Rating Scales; Research :-E-:aDac^;gy ; 
*Role Perception; Socialization 

Clinical Nursing Rating Scale; Nurses pr 'in. = : 
orientation Scale 



AB STB ACT 

The applicability of fei factor analytic apprc^. 
explore the nature of a complex job performance criterion rr 
practice and to determine the dimensions of this criterion 
investigated, A national sample of 1, 038 nurse edttcators f r b 
randomly selected" programs judged performance criteria conr.^- 
the Clinical Nursing Rating Scale and the Nurses* Profdssi^r^^l 
orientation Scale, A common factor analysis was candiicte-; c-. id^flei^y 
dimensions of nursing practice underlying the scaieis. inuaruii 
consistency estimates and item-1:otal subscale score correii ■ -tt^ wszs 
calculatfed to excmine stability of item groupings across a r.^* 
from the same population, A nested desiun m,ultit>i.8 aiialysi- o 
variance was u«ed to investigate lihet her the moan subscale ac^ar'e^ 
differed among faculty members from the three types of nu£32Ji?r 
educational programs (diplojaa, associate degree, and baccstiaur^j- 4. 
Four stable factors emerged. Factor I represented an interperso ^ 
dimension. Misconceptions an;1 myths about nursing loaded ?acr> 
II factor III repres«nted a cognitive-leadership compontrat, and 
Factor iV represenl^ed dei)enaent nur??ihg functions, internal 
consistency for these sutoscales using coefficient_ alpha -aaged xrc 

81 'o .91, .Item-subscale correlations consistent_y were nigkest r-^r- 
the *ubscale on which the item loaded. Faculty from. the caree ry?as 
of - irsing educational programs did not differ.. Appended Ba.te=:sl? 
inc de a bibiiography, -sample items from the rating scales^ asfl 
inlv nation on dhafacteristics of participating nursing fasultj 
ae^^rs. (Author/S») 
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Percexved Dinensions of Nursing Practice; 
A Factor Analytic Study Using Nurse Educators 

The ccmnaitJten to admit applicants who will succeed r nursing 
has existec_3ince the foundation of the first schools of nurs.jig. Three 
THior crite=.a (opera-: onal iefinitions of "success") hav^ be~ used: 
attrition^ aaadem.c perfonri^nce and performance on state licer:sing 
examuiEi-iais. But as ari uj.-irnate criterion, none of th^e are satis- . 
facnary. 3^ ssrious def i:-it in predictior studies of suc:::ess m nursing 
is that an ultriirate critsrion, nursing practice coiretaicy (on-the-jol>- 
perf ormance) , has not bee adequately considerec 

Why '^^'^^ nursin^" pi^^ctice corpetfjicy -Ot teen usee, as a criterion 
v- iaLiB in pr&dictia. ' zr^es? Why has th..: .en the least investi-- 
OKi-^ 3ret y oredicti^. x: nursing? Abdell .1961) sucigested* that 
th;_5 ahsercn ---r.f researrr. due to a lack o: clear definition of 
mor'sing. xez'in other :--rh related profess ;ans, which also lack 
cr2~arly definad^^dorains -i:: -::linical practice, diere have been at - least 
jpreliitdnar; • a-'iteitpts to s-uay the nature of ccrrpetency in professional 
prs:tice H-tmcer, Salkii., Le^. & Hildebrand, 1975; Johnson & Hiarley, 
igriS; Liiri, 1970? Price, Tay_rr, Richards, & .::icohsen, 1964; Schatz, 
1976) • ±iese disciplines -rhere have also :::een efforts to investi- 
gate itetterds of iieasuring praizxice corpetenci' (Blum & Fitzpatrick, 
1365; Brraie^gck & Howell , 1972; Cowles & Kubany, 1959; Crocker, Mu'thard, 
Silaymaksr ^ Samson, 1975; Hc&,sell, Cliff, & l^ewman, 1960; Johnson & 
l^vrley, 1976; Newman, 1951; Taylar", Lewis, l^elson, Longmiller, & 
^rJx:e, 1969; Wightman &"wello::k, 1976).- Measurement techniques arid 
scatistical pirocaiures that TvdJ.1 help in' devBloping competency criteria 
dc exist "..(e.g. jr Brcaidt, ,1971 Bn^tiback & Vincent, 1970a; McDem:)tt," 
fc3uire,'=& Berner, 197$; Mehrabian, 1969; Qratio, 1976; Price, Taylor, 
P.idharcs, & Jacobsen, 1964; Schatz, 1976; Valdez, 1977)^. Thus similar 
pffcor.ts in mousing seemed timely and appt?opriate. 

To pursue such -inquiry, one must first consider ' vdiat experts in 
tiie area of criterion deyeloptent guidelines on ■ 

-ow to attack the problem of.' identifying -and Quantifying a competency \^ 
critprijon. Dunnette (1963) / Ghi^elli (1956).., Thomdike (1949), and 
Toqps, (1944) have proposed tiialt successjEul job p^ is multi- 

dimensional . iXmnette : ( 1963 ) ' has iraplojred researchers _ explor ing this - . 



CTiterion problem to stop searching for tihie single criterion. Viewing 
a ccnpetency criterion as nualtif aceted suggests 'that examining the 
criterion's dimensionality is appropriate and^ necessary. One must 
examine v*at variables iteaningfully contribute to the conceptual 
criterion and determine what elements are alike. Additionally one 
must, investigate how the perfarmaaice criteria dcombine and arg organized. 
Thus the nature of the behaviois that compose the conceptual criterion 
becones itcre clear. ''Rirans (1957) pointed ro logical classification 
and intercorrelatianal study as useful for this purpose. 

Genially in the past identifying the corponents of nursing 
practice conpetency has not been pursvured through errpirical nethods. 
When developing instnoments to evaluate rivirsing practice cotpetency 
nurse researchers have consistently relied on a rational approach. 
EiTpirical methods for criterion development need to be investigated 

in nursing. . . ^ . 

One approach that allows investigation of dimensionality is 
factor analysis. '' This technique provides a means 'to empirically 
combine multiple criterion elements, perfoarence criteria (observable, 
behaviors that are related to the concq^tual criterion) , on'tiie basis 
of their intercorrelations , permitting identification of the conceptual 
e&riterion's underlying diinensions. By applying an enpirical factor 
analytib approach to criterion development not only can the conceptual 
criterion's cOTposition be expired tut the criterion's diinensional 
characteristics can be" ii&entified. 

When a conceptual criterion's corpositicn is explored, one must 
^also consider "the dimensional characteristics of the criterion in- 
cluding the matter of relative iirportance of each corponent of the 
dinension and of 'each, dimension's contribution to the overall . 
criterion" (Ryans, 1957, p. 39). With factor anedysis the relative , 
iirportance of each criterion element to the dijmension and each 
diinension's iirportance ,to the criterion can be examined. 

Another aspect of criterion developmerit ' is to examine the 
iritercorretation of the criterion"' s dimensions. Such an investigation 
allo^ a. bfetter understanding of the nature of ^the dimensions ^ and their 
relationship to one another, Tl^e dimensions' intercorrelations can 
be pbtainedx with factor analysis 



:rure that an enpiri- 
rrempted to identify 

cf the concepUial 
e inte::'corr elation 



There 'is no eviderice ir. the nur-'n^i ii 
cal approach to criterion develcrnient i ^^ 
dijtienHians, criterion^ eletpents ^ or exp-i^r U:.:, 
critericai carpetent nursing practice, 
of dinBsnsions been investigatec 

There have teen a few E-'udies : 
have used' a factor analytic .appr 3ach f c 
developnrent. Bnambcck and Vincer.t (197 
build a perfonnance appraisal s-jstem fc 
United States, Public Health Service us : 
to identify the basic areas of work 2c^-ivl=ies . Ihey then used a 
cluster analysis to group positions th^"^ v/er^ al_Jce in idieir setup of 
duties. The authors eirphasized tha- i ty7^ cf job analysis has 
^eriabled^the production of a iroire effecuve ^^^rtr :inance appraisal system. 

Price, Taylor, Richards, & Ja ;a • 4) believed that "basic 

to better selection, and more satisf ac ^ or;^ training, of medical students 



- : -^a^ ::n related fields that 
■l oar :rmance criterion 
irOr in attenpting to 
:cnr:L3i:_:^ed officers in the, 
fac-^^r Tnalytic techniques 



is a clearer knowledge than we now pc 
produce - a more def ini\:e caicept of 
good physician'" (p. 230^. To explo: 
representative saitple of physicians 
200 measures of physician inforitatiop 

0 

-analysis, dimensions of physician peril 

^ <*• * '. 

factor score profiles were derived. 

Johnson and Hiar ley (1976) us. 

identify the dimensions of ^try lev 

(1976) also used factor ar^alys is to 

by supervisors to evaluate the thera^i^- 

in their speech pathology clinical f-. c 

^ These .'studies offer:' evidence ~ 



of what v?e are trying to 
irplied by . the term 'a, 
ctnc^pt a well diversified 

\'nas selected and over 
"'.ecrted on. each. By factor 
- »tare derived and then 



-:ac;tor analytic approach to ' 
ctice for dietitians v Qratio 
^-y the major dimensions used 

c effectiveness of students 

.cum. 

:.the factor analytic approach 



may hold promise for conceptual crit^nrr development in the health 

related fields. ] ■ ^ 

iRyans. (1957) stres.^ that anottr-- issue in qriterion development 
was the generalizabi^ity of the dimensioos cf eleitients to additional 
sanples of the same pqpulaticn and to saiL:iles of other populations. , 
Thus deriving dirtensi of competency through a factor analytic approach 
that groai^ criteribn eLaneats into factors (dimensions) . requires the 
demonstration that the grouirijigs are stable. Specifically it must be 



shown urat the diinsnsicns are not unique * to the saiiple^ Kith a :A-:tor^ 
analytic approach, 1.1 - essential that dimensioas gmeralrrxi ain at 
factor loadings and iac weights generalize to. sate extant o I. 
-. nursing -:Jiis genera \7rrr ' ity-^'iss^ue has been dealt v/it t by sait^l. ■ ; 
from niiTHing experts rncnsr, t: ' \- using larger sariples and croc 
validatioi techniqu^^ . ' ^ 

JO utilize^ a fs::-:.ar ar :-^'ric approach, an e5S9ntial ingre:-^ent 
is the iaentificaticn cf cxitc icn elements. Although the concep-Tjal 
^criterion of corpetent nir:r.v ; pzsriiice has not beea clear 1;;^ defined, 
elements of the criterrcE Cc.. ai±^have been identified., A fewcstudies 
reported in theT nursing -it^^: ature in the area of on-the-job nursing 
.performance hav6 explored wcr£x benaviors ought to be exhibited by ^ 
"good" nurse (e.g., BranSr, Hasta^ & Schuiiiann, 1%7; Holliday, ii^6I-; 
Taylor, NahiUr Harms, Bernnolc^ & Wolfer^ 1966). &cm researchers have 
atteirpted to -identify cri:cical nursing behaviar<'r "^n the hospital s-etting 
tha:t iiTprove the patient 3 health status (e^g. Ijoiiidfay, 1961; sen, 
1960? Whiting, 1957) . h. team of nursing service rei/^^archers in ai. 
extensive stiady reporbsd tr^ Gorham (1962) identified a pool of iirportant 
nursing practice beha'cloirs. In fact instruments coiposed of behaviors 
and traits (performance criteria) judged to be iirportant for coipetent 
nursing practice have oeen described in the literature. These include 
the Clinical Nursing L^ating Scale.^ (Reekie, 197b) , the Niirses' Professional 
Orientation Scale (Crnccer & Brodie, 1974) , the Slater Nursing Ccnpe- 
tencies Rating ^ale I'vandelt & Stewart, 1975) , and the Nurse Corrpetency 
Inventory (Nelson, 19'"£) • ' «^ 

Authorities in. the criterion area (Astip, 1964; Ryans, 1957; 
Toqps, 1944) repeatedly have stressed the' deriving a criterion event- 
ually requires a judgen^ :t c»: set of judgements. When using such 
techniques as factor ar^jsis to explore the nature of a conpetency 
criterion, someonev must :;::jdge how relevant each performance criterion 
• is to the conceptual crln^rion. Nurses as opposed to physicians, 
hospital administrators rr errployers must serve. as the judges for 
weighting the relevance crfl each perf ormancie criteria to the conceptual 
criterion, conpetent nurning practice. 

Nursing educators are one .of the groups in* nursing v^o should 
serve as judges of performapce criteria importance to the conceptual 
qriterion,;conpetent imrr^ing practice < Since there are three different 



types of nursing educational prcqrazi . it was alsc necessary to know if 

the facult;^ from these programs nc..^ similar views of v^at ccaistitutes 

desirable — acrice in nursing, Th_ is not to say nursing acucfators 

are the or group v>^o should sei as such judges out for tiiis initial 

study only :ne group in nursing k-ei ^aitpled. 
\ . ' ■ 

^ Statement of :ne ProLiQT: 

The purpose of - this nethcd: logical study to investigate the 
applicability of a factor analytic approach to exr-^c^e the nature of a 
conplex job performance criterion and to determirie the dimensions 
(cdTponents) of this criterion. Pn errpirical appr\?.ach to criteriqn 
developre^t using a factors-analytic technique to xamine the dimension- 
ality of the conceptual criterion coropetent nursi"ig practice, the • 
'dimensions' intercorrelations, the dimensions' ar.u the performance 
criteria's weighting, and the diitnnsions' generalizability to a cross- 
validation sairple was explored. 

This study served to demonstrate an errpirical approach that can 
be "utilized to investigate the nature of the caiplex conceptual cri-^e- 
^rion,. job perfoiTiiance conpetency, through factor analytic techniques 
and to demonstrate a method tor generating measures of nursing practice 
cofipetency. From this study, it vvas possible to assess if ttds eripirical 
apE^oach to criterion development led to the identification of stable 
dimensions of niarsing practice conpetency and.to determine if , the . 
approach should be extended using the same techniques to different 
populations within the nursing profession. . 

Methodology 

The Subjects ^ . [' o 

The respondent pool consisted of registered nurses arployed as 
faculty msnibers'in National League forNyrsing (NLM) accredited nursing 
-programs. Initially 30 schools were randomly selected from each NUN 
listings of accredited nursing^ programs — diploma^ 'associate degree 
and baccalaureate. Although associated degree programs outnumber . ^ 
baccalaureate degree and^diploiba programs (603 to 316^an(3 426 respec- 
tively'), baccalaur6ate nursing facull^y outnumber ^.associate degree and 



diplotia nursing feniLty (10,750 to 7,288 and 7,407 respectively) > ( Facts 
. About Nursing 16''~J, 1977) . ^ Thus equal nuinb^s of each program type 
were sanpled. 

During Ocfccbsr, 1978 to January,] 1979, each selected program's 
head (Dean or Dir^mnr) -was contacted by mail requesting her nursing 
faculty members' psr^icipation in the study. After her poc:^)eration 
was^Qbtained, a cu^ lionnaire for ea:..- faculty member with a cover 
letter v.^ sent ti: -ine program head. The Dean or Director superv^ed 
questionnaire disrr:^bution to the faculty. Each participant returned ^ 
the ccxrpleted qCistiannaire to the Dean's^ or Director's office in' a 
sealed envelop tc assure anonymity. Following this th^ set: of sealed 
carpleted questicamaires -was mailed to the researcher. 

Twenty-t :.gh:r diploma program" directors agreed to ask their 
faculty to part:.cipate. In these programs, 382 of 506 faculty members 
returned corrpleirad questionnaires,, a 75% return rate. 

Although 21 of 30 Deans from associate degree' programs agreed 
to ask their fa£:ulty to participate, 17 additiona]^ r3ndomly selected 
progxCTS were contacted to assure a minimum representation of 300 
associate degree nursing faculty members. Thlc teen. additional Deans 
agreed to partidipate. Also associate degr^ faculty members enployed 
in a combination A.D.-B.S. ir-. participated. Thus 35 faculties 
wer*e represented in the associate degree nursing faculty sanple, and ^ 
349 of a possible 494 individuals partici.pated, a return rate of 71%. 

Nii^eteen Deans from baccalaureate programs agreed to participate. 
?\n additional 5 to 13 randonily selected baccalaureate program Deans 
agreed to ask their faculty" to participate. Of 553 faculty members, 
357 returned conpleted. questionnaires, a. €5% return rate. 

AiTOig the nonpar ticipating programs, 24 did not respond to the 
initial contact 'letter, nine responded but declined to participate for 
the reasons .indicated below: 

1) t\K> institutions were undergoing .accreditation, 

2) faculty had too heavy a teaching or administrative load 
o at the time, . 

- 3) participation required too nuch facnalty time, . 

4) two faculties were occupied -with major curricular 
revisions at tiie time, 

5) 'the study was conducted too close. to the end of the .. 
' academic term, ^ ■ 

6) V faculty were already overtested, 

7) faculty lacked tijne to participate in such a study. , 



' The. overall. respondent pool was 1038 faculty members. Ten 
faculty' members were dropped from, the sanple because portions of the 
questionnaires were inccnplete. Descriptive characteristics of^part- 
iclpating prog^^ms are presented in Table 1. * The number of respondents 
fran any one institutions ranged fron 1 to 34 persons.,, constituting 
fjran 0% to 3% of the total respondent pool^^ The overa;i response 
frequencies for the biographical information including geographical, 
demographic, atplqyiTient and educational characteristics of particuL- 
"pating faculty are presented in Appendix A. 

• Ihe i^asures .• . . 

Two rating scales were us^, the Clinical-Nxarsing ''Rating Scale 
(Reekie, 1970) and the Nxarses' Professional Qrientatidi Rating Scale 
(Crocker & Brociie, 1974) . The ClinicalT^ujrsing Rating Scale was based 
cn the work of 'Jensen (1960) and'Gorham (1962) . In addition, Reekie 
Kfamined 29 oMier 'writt/^ :.ources dealing witii traits and b^.aviqrs 
viewed "as inpori-^t to patierit welfare. Fran 8S§ statAatients of nursing 
behaviors, 132 distinct b^viocal descriptions were derived that 
nursing experts then rated on level of iroportance and ^on item quality. 
Items having above the msan scores'->?efe theri Q-sorted by otiier nurse 
experts to arrive at the final 25 "most iitportant" behaviors.! The 
internal consistency of the scale was examiiied using factor, analysis,. ; 
The- instrument'^ content va.lidity was a'^tablished by nxarse experts. ~ . 
,Cr iter im-referenced validity was ° explored by correlating the scale's . 
total rating score with total college GPA (r = .50) total mor^iJig 
GPA (r = .52) , and upper division nursing GPA (r = .53). The Clinicar 
Nxarsing Ratiiig S^^e was chosen for this study because the instrument 
w^ soundily- developed using proven techniques, i.e., critical incidents 
and Q-sort iteJJiodology, it was designed to serve as a criterion measure 
for predictive purposes and it provided a way to tap the previous work 
of Jensen (19,60) and Gorham (1962) . Also its length allowed a second 
instrumsnt to be included in the questionnaire without requiring partici 
pants to invest an" iiibrdinate amount of time in conpleting' the question- 

naire. , ... ; ... • ■ ^ _ , ; : 

The Nurses' Professional t>rientation Rating Scale was developed 
by Crocker' and BEOdie (1974) to serve as a measure of ability to assvime 



. ' ' ■ ■ Table 1 ' " ' . ' 

: ^ . • - : — . ) 

Characteristics of Participating Nursing Faculty 
Members 'and Participating Nursing Pro-ams 



\ i ' • Participating Nonpar ticipating 

■ ' / ' ^" ' Program Prcgram 

r / ' Faculty -Adjusted I'requencies - Preiqueneies 

Characteristics Ftequer^ies » Percent Dip^ AD. Bac. Dip.^ Ad. Bac. 



Region of country 



Northeast 

Northcentral 

Northwest 

southeast 

Southcentral 

Southwest 

Size of Cit^- 



413 
154 

48 
245 
139 

78 



over a million 61 
•over 100, 00 J. bat 415 

less than a million 
over SO^OOa but 274 
' liess than' 100,000 
.under '30,000 . 327 

Funding and Affiliation 



State 


322 


Catholic 


203 


Lutheran 


40 


Metiicdist 


• • 34 


Baptist 


' 13 


Seventh Day 


35 


Mventist 




Private 


138 


Coninunity 


170 


City 


122 


Mennonite 


7 


Evangelical 


0 



Type of Educational 
Institution 

University 
( yr^K^ — CcjUege ^ , 

Junior, Coinminity 
or Technical College 



38 


14 ' 


8 


7 


2 


3 


6 


14 


t 6 

t u 


2 


6 


Ov 


• 2 


4- 


4 


0 


5 


0 


0 


1 


0 


23 


' 5 


9 


6 


0 


5 


3 


13 


3 ' 


8 


- 


0 


.1 


2 


7 


"^0 


2 


2 


0 


0 


4 


6 


4 


0 


2 


0 


0 


.1 


39 


13 


13 


4 


■ 0 


5 


9 


25 


- 8 


9 


7 


1 


■2 


5 


30 


3 - 


,12 


11 


1 


5 


4 


30 


0 


12 


10 


• 0 


1 


11 


19 


7 


0 


8 


1^ 


0 


3 


4 


2 ' 


0 


2 


0 


0 


t) 


3 


2 


0 


0 


0 


0, 


0 


1 


1 


0 


0 


0 


" 0 


0 


3 


0 


1 


1 


0 


'' 0 


2 


13 


7 


4 


0 


0 


1 


1 


16 


3 


14 


. 0 


0 


10 


0 


11- 


6 


3 


2 


1 


0 


1 


0 


0 


0 


1 


0 


0 . 


0 


0 


. 0 ' 


0 


& 


0 


0 


1 


o 
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12 
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X 


12 


0 • 


1-3- 


12 


0 . 


1 


7 


0 


13 


0 


0 


.10 


.0 



the prof c-ssional r^ursing role, i.e., to practice nursing corpetehtly. 
The. initial item pool ccaisi&ted of 112 characteristics frequently used 
to describe" nurses in their professional role. A final subset of 59 ^ 
items i?fes chosen by correlating item scores with class rank on the 
assun^ticn* that advanced 'students should 'b^^ more professionally 
"sbcialized"' than ' younger • students ^. ^Tlie internal caisi^tency of the 
scale cOTEulzed. on*" a cross-validation group' using Cror^bach's coefficient ^ 
alpha was r •Sg. C^truct validity was Suggested by finding that 
significant. differences existed, between means ^ of each adjacent pair of 
classes. 'The ^^urses' Professional Rating Scale was selected as' the ■ 
second ins'truKtent because the instruinent was conposed pf a mixture of 
items that tanged in"" iirpcrtanpe from ui^desirable to extrenely irrportant 
in relation to conpetent nursing .practice.- Thus the instiament ,was less 
susceptible to response bias tHan other available instruments*. 

^ ^ For both instniments the nuvsing^'faculty members were asked to 
judge each item's iirportance for- the practicing professional nurse. • 
The order of the two scales was randomly varied among the ^jc^ams to 
eliminate any systematic variance due to-order of scale presentation. 
Standard .-instructions were usejd and a standardized ' biographical 'inventor;, 
was collected from each participant.- Sanp.le items, from both, scales are 
presented in J^)pendix B.. ^ • ' - 

T he Research Questions ^ - . ^ 

^ The research questions were as follows; , ' 

,1> With an ifeem pool create^ by combining the Clinical 
Nursing Rating Scale ' and. the Nurses • Professional 
Orientation Scale, ^lat underlying dimeiteions (factors) 
emerge vAien respondents rate each item ^\ the item pool 
as to iiiportance to the conceptual criterion? 

2) When items are grouped into subscales 'On tbfs basis of 
factor coefficients, are these siibscales hcftogenous 
v*ien administered to a crbss-vialidation sample? 

3j Are there differences oh mean subscale scores among 

fiursing^ faculty members from the three distinct types of 
educational programs, i.'g.r associate degreerbaccalau--' 

reate degree, and diploma programs? 

* . * . - » 

Analysis of the Data and the Results 
The respondent pool within each type of educational program was" 



randonrily split in half to create two groo^. One group 'was vised in the 

factor analysiis to determine tiie itens' underlying diitiensiors (n = 540) . 
. The other group served as the cross-validation sanple to test the 

hargeneity of the subscales and the differences in mean si±scale scores 

among ihe faculty frcm the three educational programs in nursing.- 
^EvMence for hannogenisity was def ified to be high internal consistency 
•estimates (coefficient alphas) and correlations that demonstrate that 

each item correlates mor;e close^^y with its ^otal subscale score than 

any other subscale* score. • 

Occasional missing item responses were handled by using the ^ 

modal resp^is^ for the item. If more than eight items were missing, 
-the questionnaire was not scored. ^ - 

I - ■ v.' : ■ : ' ■' ., , 

Factor ' Analy s is ^- 

COTinoh factor analysis y/as used to determine the underlyang 
dijiensions of the 'ratii^g^ ojE the item pool created by ccmbinihg the 
two rating scales. A principal axis solutibn was initially rotated 
to a varimax criterion using Guertin's Ed '501 program (l^uertin s Bailey ^ 
1970) . ' "Vtik criteria used to determine the number of factors were: 
(i) ' majfimum number of factors = 2.0 number of variables + .5, (2) 
minimum latent root value = (number of variables/75) + .20, and (3) . . 
visual inspection of several r6tatioai trials^'to determine the most 
satisfactory himiber of factors. ' Then ^ the principal axes were rotated 
to an obliqui solution using Guert^'s Ed 512 program' (Guertin^ & 
'Bailey,- 1970.) to obtain fafctdr intercortfelation coefficients. 

A five factor ^orthogonal solution was* determined' to be'appro- 
priate. A solution with fewer factors rotated resulted in cciTpression 
of the^ last factor .into prior factors. Rotation' of si:^ or mare factors 
provided a less clear factor structure with factors 'emerging that had 
very smaH sums of the" squared factor loadings. From the primary 
factor 'intercorrelation matrix (see Table 2) it was detei^nined that the 
factor intercorrjslation mlir'ix were relatively small, therefore the 
orthogonal irotation was^satisfactory. The sum, of the scared factor 
loadings fpr the .five ^ factor orthogonal salution was 28.51/ that was' \ 
'34% of the total score variance and 55% of the tbtal comm variance. 
In terms of va):iance accounted for this was considered a satisfactory 
solution. The sum of the squared facjtor loadings for each rotated- 



factor was: 

.Factca: il ":a.05 
Pactor II • 7.30 
Factor III « 6.21 
Factor IV/^.4.98. 
Factor - V « 1.97 



• Table 2 ' \^ . 

Intercorrelatiosis of the Oblique S^ution Primary 
Fact6rs for One-Half the Nursijng'.Faqulty ^aitple 



Factor 






Faculty 






I 


II 


III 


- IV 


V 


■ I. ^ ■■■■ 


1.00 


0.04 


0.41 


1.22 


^ -0.02 


II 


0.04 


i.oo 


-0.11 


^ 0.38 


0.14 


III , 


0.41 


-0.11 


1.00 


0.21 


-0.03 


IV. 


6.22 - 


0.38 


0.21 


1.00 


.. 0.05 


V 


; -0.02 


0.14 


-0.03 


• 0.05 


1.00 



The first four fafctdrs squared factor. 

loadings and sufficient items loading on them to suggest that the factors 
-might be'rs table. • - very small sum of 

squared factor loadings ah^: few items loading on it. It appeared, to be 

un&tablfe. The factors and factor loadings of the.Clinlcal Nursing 

Rating 'scale and the Nurses' Professional Orientation Scale for the 
- cuialysis are presented in Table 3. , , — 

■ Fk;tOT I arose from items cdt^ 

Scale. .The.,f^tor involved items that show the nurse as a caring., 
« siippbrti^f^son vdio ihdivid^^^ care to meet specific 

patiieht. heeds as well as' having personal integrity , self control, -.aftd- an 

■aijility to. work effectively with others. Exairples of ".tems loading on,- . 
.. Factor I included all items appearing , in J^pendlic B; The Clinical , ' 

Niorsing Rating Scale. ^ . T^ items, all had a modal response of iinportant 

(; 4 items) or ejfeemely iitportant (16 itente) . 



Table 3 

Factors and Factor Loadings Using a Varimax Solution for 
• One-Half the Nursing Faculty Sarnple 









Factor 
















Item 




I II 


. Ill 


IV. 


■ V. 


Factor I 






-67 








1 9 




64 








Id. 




• oo 








22. 




.63 








lb. 












5. ^ 




.63' 








23. . 




..62 


■ -..5 






17. 




- ■ .61 








u. 




" .59 








9. 




.59 








8. 




.59 


.32 






24. 




.58 








6. 




" .55 








25. 




.53 






\ 


7.' 




■ .51' 






r 


10. 




.51 








18. 




.50 








3. 


r 


.46 








4. 




.45 








21. 




.44 " 






.31 


14. ' 

1 


J 


.34 










Factor II 





















39. 
70. 
68. 

36. - 

62. 

61.' 

57. 

71. - 

29. 

42. 

83. 

54. 

26. 

32. 

53. 

38 



.61 

.6L 

.61 

.60' 

.58 

.58 

.57 . 

.55 

.54 ' •■ 

.53 

.53 

.50 ^ 

.49 

.48 

.46 ' • .42 

.45 . :3i 



Table 3 — Continued 









Factor 




Item 


I . 


II. 


-III,,. IV 


V 




Facter 


II 







48, 



47. 
79. 
35. 
52. 



82. .45 

41. .40 .33 

31. , .40 .33 

84. / .39 

80. .34 



Factor III 

66. 

72. „ , .63 

74. ' .63 

81. ' - . 

39. ■ •■ .31 .61 

77; .61 

76., .58 

50. ■ .32 .53 

65. ■ ' .51 

28. • .46 

A9z' .45 

27. " -44 

37. ~ .30 .44 

60. . ' . .43' 

78. . , .40 

■33. - - . . .37. 



Factor IV 



.51 



44 > . .49 

59*. ' .43 .49 



'.48.., 
.48- 
.44 
.42 



64.- . ■ ' .31 .40 

13. .38 ' .39 

58. ^ , -36 



56. ■ ' ' - -59 

55. ; * -54 

5i: . ..54 

73. .31 .53 



Table 3-- Continued 



Factor 



Item • I II III IV 



30. ' ' ' ' ' -41 

45. I .37 i .37 

34. -37 

63^ \ -.30 .36 



eeIc. ■ " .0 IS 
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Items loading on Factor II r IHr IV, and V cane from the Nurses" 
Professional Orientation a^ale. Twenty-one items corposed Factor II. 
Exanples of items that locided on this second factor are indicated in 
^ippendix B Nurses" Professional Orientation Scale. Although the 
ratings ranged, fran 1 to 5, items, on this factor had the highest number 
of landesirable (4 iteiiB) and not at all iitiportant (2 items) ratings of any 
f&ctor^. Thirteen items had a modal response of 3 (slightly iitportant) 
v*iile two had a modal response rate of 4 (important) . Thus this factor , 
measured a dijnsnsion that was not relevant to carpetent nursing practice. 
These were the uild6sirable, irrelevant or only slightly iirportant 
elements of co^ipetency according to the faculty sampled. 

Sixteen itene loaded on Factor III. The items reflected cogni- 
tive abilities » including possession of a sound knowledge base and ability 
to problem solve as' well as cannunication skills aid leadership skills. 
The irexlal response for all the items on this factor was 4 (important) 
for 10 items or 5 (extratBly important) for 6 items^. Therefore faculty 
msnibers generally rated these items as iirportant, sometimes extremely 
important. Exanples of the items loading on this factor are indicated 
in Appendix B 'Nurses": Professional Orientation Scale. 

Factor IV was ccnposed of 14 items with only one, from the 
Clinical iSlursing Rating Scale. The factor reflected satisfaction of 
physician 's'^and eitploy^"s demands in terms of performance, manual 
skills r and a clean ^ unif anted" appearance. These items ratings ranged 
from 1 to 5 r but the mDdal response rate was 3 (slightly iitportant) for 
nine iteitB and 4 (iirportait) for the other five items. Clearly^ this: 
factor was considered less jjtportant to nursing practice cotpetency 
than either Factor I or Factor III by faculty., in tiiis study... Exaiti^les 
of itesms loading on this factor are indicated in ;^>pendix B Nurses" 
Professional Orientation Scale. 

Only four items loaded on Factor V. The loadings were relftive- 
ly small^ that is the highest was .41. The modal response was 3 
(slightly itiportant) in two instances^ 2 (not. at all iitportant) in 
another case and- 4 (iirportant) in the fourth instance.' The items load- 
ing on the factor were: 

30. Enjoys working with children. 

45. Enjoys working in all clinical specialty areas of , 

nursing. * ^ 



34. Eh joys -working with' pati^ 

63. Takes a leadership role in local, state, or national 
professional organizations. 

The factor was apparently very unstable and it is doubtful that^ these 

iterns identified a dimension of the criterion carpetent nursing practice. 

Initially 'the scales used in this study were selected because 

it was felt that they assessied different caGnponenlSs (diinensions) of the 

domain conopetent nursing practice ^ Since an^ factor that emerged On . 

the conition factor analysis was formed by behaviors and traits from 

eith^ the Clinical Nursing Rating Scale or the Nurses' Professional 

Orientation Scale, this initial assuirptioh seemed' to be justified.' 

- ■ / •• ^- ■ ' • ■ '. . ' ■ ■ ■ A ' 

Homogeneity of the. Subscales \ 

5 When utilizing '^a. factor analytic approach to explore the nature 
and dimensionality of a job perfoprtance critieriai 'such as conpetent 
nursing practice, it is critically iirportant to demonstrate that the 
ap^oach yields stable factors. If such stability \could not- be demon- 
*strated on a cross-validation sample from the same population, further 
exploration of this approach and use of these factors in criterion 
develcprient would , be uselessT" 

To establish the subscales the. factor coefficient weightings 
were used rather than the factor loadings. When der:ivijig subscales 
"through' a "fap tor analytic, approach, Gorsuch (1974) recamiended using ^ 
the factor coefficient- weights. : These weights are the regression - 
weights that would be used to estimate'^ the factor. from tlie observed i 
variables. The factor structure matrix gives only the correlatioi 
coefficient between eacji variable* and each factor. 

Subscales were crea:ted by' grouping items according to their high- 
est factor ^coefficient weights (Gorsuch, 1974) . Scoring weights were 
determined for the Nurses' Professional Orientation Scale by reflecting 
those item? that had^a negative factor cbeffici' .it weighting. Fifteen 
items were reflected using this method. Rather thai calculate coitplete 
factor' scores, a method of ^inconplete factor scor^ calculation was vsed 
to dertemine the subscale scores (Guertin/ 1970; Gorsuch, 1974) . On the, 
cross-validation„ sample", the faculty ratings on items catposing the 
subscale were simoned to give the subsccde score. Internal coiisistency 
.estimates sp^ifically coefficient alpha, tising the SPSiS program 



Reliability (Nie, Hull, Jenkins, Steinbrenner, &Bent, 1975)^ were calcu- 
lated. Only iteite having their highest weighting on a specific factor 
were entered into the reliability estiniate " f or that factor. This was 
done to maintain independence' in the analysis (GorsucK, 1974) . The 
coefficient alpha for each .of • the subscales was as follows: 

Factor' I ^ .91 . 

Factor II .83 

Fa[ctqr III - . ?3 ' 

Factor IV = .81 ^ _ . 

Factor V - .47 , , 

Thus the four factors were highly reliable. Factor V was not 

only weak in terms of sum of squared factor loadings but it was not 

reliable. , - ^ 

After reflect jjig items on the. Nurses' Professional Orientation • 
Scale that had a negative weighting on tfe factor coefficient matrix, 
subscale scores on- the 'cross-validation sairple were calculated for each 
factor by suirming the raw data ratings or. those items corposing each 
of the five factors. Again only items having their high^t coefficient 
weighting on a particular, factor were summed to arrive, at the total 
subscale score for that factor. Thus no dependency v/as created. Each 
item was correlated with each subscale score, using the SPSS program 
Pearson Correlation (Nie,^Hull, Jenkins, Steinhrenner, Bent, 1975) . . 
These correlations v^e then examined to determine if /the item correlated 
most highly with ti^ .sub^ score on which it had^the highest factor 
coefficient weight.- • The coi^elation matijix is presented in Table 4'.^ 
With only two excQptioriS,,\ i.e. , item 8 and item 67 on Factor IV, each 
item correlated more highly with its total subscale score than with any 
other subscale score for the first four facrars. Twelve of the 23 
items ^ on Factor V did not have their highest correlation with this 
subscale* score;- . ^ ^ 

The stal^ility of the first four factors was demonstrated by the 
findings that on the cross-validation sanpl^ the internal 'consistency 
estimates for the subscales formed on the basis of f rctor coefficient 
weightings were high, i.e. 81 to .91. Further evidence of stability 
was Qffered by the f indings that the highest correlation was consistently 
between the item and its subscale score on the first fair factors. Sub- 
scale Factor V had a very low internal consistency estijtiate and the iten- 
subscale score correlatiohs were not conis/istently the iiighest with 
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'^ble 4" 

Intercorrelation Ma' Itsns With Subscale Scores on 

the Factors Cross-Validation S^le 



- Factor 



Item : • I II ^ III IV V 



ItiitB loaded on Factr^^ I (using the factor coefficient weights 

to determine the items catipdslng the factor) 

■;^>;. . ; . 'V . ' "/ ^ . . ■ ' ' 

s: ' 0.63 0.06 0.35' ' 0.15 "0.09 

6. 0.52-0.00 -0,27 0.12 -0.12 

7. «a.59 .; 0.07 0.29 ' 0.16 " -0.05 
9. ' 0;65. ^ 0.06 0.33 0.22 -0.02 

10. i ' -' ^ ^0^58 0.29 0.27 " 0.42 • .'-0,12 

■>r.^^^:0.n' 0.08 ■ - 0,43 ■■ 0.23 -0.04 

'12. - 0.74 0.08 0.45 0.24 " -0.01 

'15. : * 0.69 0.04 0.43 ' 0.22 -0.06 

: 16. 0.71 .0.13 "0.38 0.27 -0.09 

^17.. 0.71 0.06 0.39 ' 0.24^, -0.04 

. 18. 0.57 0.06 0.30 r 0.17. . -0.12 

19. .^^0v74 0.07 0.44 ' 0.16 -0.01. 

22. ■ 0.63 ^0^13 0.40 0.32 ^-0.14 

23. " 0.67 ' 0.14 0.42 0.29 -0.16 

24. 0.6 a 0.09. 0.37 0.24 . 0.14 

25. 0.63 0.07 0.44' 0.27^ -0.07 



Itans loaded on Factor II (using the factor coefficient weights 
- '.. to determine the "items cotrpos lug the factor) 



26. " 


0.04 


0.48 


-0.03- 


0.23 


-0.08' 


29. - 


~ 0.05 


0.59 


-0.01 " 


/ ■; 0.29 


-0.07 


36. . 


' .0.11 


0.61' 


0.08 - 


o:37 ' . 


-0.10 


38>. 


0.28 


' 0.52 


■ 0.19 


0.48 " . 


-0.09 


39. 


0.12 


0.64 


0.05 


0.37 . 


-0.14 


42. 


0.05 


0.-61 


-0.01 


0.31 


-0.06 


54. 


0.01 


0.53 


-0.06 


0.29, 


-0.13 


57. / 


0.09 


• a. 65 


•0.14 • 


0.42.- 


-0.05 


61. 


.0.10 


0.60 


0,07 


0.34 


-0.09 


62. 


0.06 


0.59 - 


0.04 " 


' 0.31 


-0.09 


68.. 


,0.12 


0.66 


- '0.06 


0.37 /- 


-0.07 


70. . 


0.13 


,0.69' 


0.14 


0.40 


-0.06 


71. ■ 


d.oi 


0.56. 


-0.00 . 


0.33 


0.02 


82. 


- 0.11 ^ 


.0.51 


0.18 


0.34 


: -0.03 


83. 


0.07 - 


0.65 


0.08 


0.34 = 


-0.10 


84. 


-0.03 


0.38 


0.02 


0.11 


O.OT 



TablQ 4^c3ntinued 



Factor 



Tt6m 



II 



III 



IV 



V 



Itenis loaded aa Factor III (using the factor coefficient '^tfeights 
to determine the itenis conposing the factor) 



28. 


0.29 


0.00 


0.52 


0.13 


0.01 


33. 


0.24 


0.05 


0.52 


0.12 


0.06 


37.° 


0.34 ^ 


. 0.16 


0.45 


0.26 


0.06 


49. 


0;35,. 


0.14 


.'^ 0.54 


0.29 . 


0.02 


60. " 


0.26. 


0.12 


6.52 


■ 0.33 


0.02 


65. 


0.26 


0.06 


0.55„ 


0.24 


0.09 


66. 


0.34 


0.03 


0.54 


oa7 


-0.06 


69. 


0.41 . 


0.02 


0.64 


0.21 


-0.02 


72. 


0..46 


-0.01 


0.67 


0.22 


-0.02 


74. 


0.35 


0.06 


. 0.62- 


0:22' 


-0.06 


76. 


0.38 


0.09 


0.70 


0.37 


-0.06 


77. 


0.46 


-^0.15 


0.67 


0.30 


-0.08 


78. 


0.25 


-0.01- 


0.54 


0.26 


-0.03 


81. 


0.35 


0.02 


0.(51 


0^22 


-0.03 



Itoms loaded on Factor IV (using the factor coefficient \yeights 
to determine' the items ccnposing the factot) 



8.a^ 


-0.66 


0.01 


-0.44 


-0.05 


0.05 




13. 


0.42 


0.16 


0.21 


0c46 


-0.21 




31. • 


0.16 


0.43 


0.12 


0.55^ 


0.03 




' 44. ^ 


' S 0.33 


0.34 


0.24 


0.57 


. '-0.13 




47. 


0.33 


0.33 


0.32 


0.58 


-0.03 . 




48. 


0.3? 


0.28 


0.3^ 


0.62 


-0.11 




51. . 


0.32 


0.35 


0.35 


0.65 - 


-0.05 




52. 


0.23 


■ 0.31 


0.32 „ 


0.50 " 


-0.t)6 




55. 


0,18 


. 0.27 


■ 0,21 


.t).5e 


0.03 




'56. . 


0.17 


0.28 


0.24 


0.6.1 


' 0.02 




59. : 


0:09 


0.53 ■ 


0.06 


• 0.60 


-0.14 - 


•7 


64; 


0.21 


0:40 . 


0.31 


., 0.56 » 


-0.18 




67.a 


0.25 


-0.06 


0.37 


0.23 


b.io 




- 73 ; 


0,13 


0.42 ' . 


0.16 


. 0.59 


-0.15 




79. 


0.23 


0.31' 


0.'38 


0..61. 


.,-0.13 ' 






loaded'; on Factor V (us'ing the factor coefficient weights 
to'detennine the items ccnposing the factor) 



1. 
2. 
3, 
4. 




-0.25 
.-0.16 
-0.23 
-0.20 



-0.07 
-0.04' 
-0.09 
-0.15 



0.37. 
0U7 
0.43 
0.47 



Table 4-K:Qntinues 



Factor 



Item I II II IV . V 



14 


-0.20 


-0.10' 


-0.14 ' 


-0.09 


0.54 


20 


■ -0.04 * 


-0.06 


O-0.06 


-0.18 


0.53 


21 


-0.29 


-0.09 


-0.23 


-0.20 


07^1 ^ 


27 


-O.ll 


-0.01 


-0.22 


-0.01 


, 0.40 


o\j • 




0.17 


0.14 


' 0.22 


0.33 


12 a 


-0.03 • 


-0.48 


-0.02 


fO.28 


0.31 


. 34. a 


0.14 


-0.40 , 


0.23 


.0.37 " 


0.21 


• 35. a 


-0.24 


-0.40 . 


-0.24 


-0.52' 


0,27 


40 .a . 


0.20 


0.34 


0.25 


0.47 


0.15 


41. a' 


-0U4 


-Oi47 


. -0.06 


-0.45 


0.31 


43. 


<r -0.01 


0.18 


0.07 ' 


0.16 


'0.23 


45 .a 


■ &.d8 


0.40 


. 0.15 


0.32 


0.21 


46,'a 


o;j.o 


0.35 


0.06 • 


0.32 . 


0.20 ' 


50;a 


0.42 


■0.04 


0.-59 


0.23 


0.11 


53. a 


-0.26 


-0.44 


-0.16 


° -0.57 


0.22 


58. a 


' 0.12 


0.32 


0.21 


• 0.41 


0.05 .. 


. 63. 


0.15 


Q.06 


0.35^ 


'0.19. 


/0.35 " 


75. a 


-0*13 


-0.35 


-0.23 ' 


-0.35 


0.31 


V 80. a 


-0.17 


-0.30 


-0.31 


^-0.42 


0.23 



highest corfelaticn not with factor on which the itan wa^^ loaded 



this- sutsctle. 

Thus on .the }5asis of these two cturrelational analyses, the sub- 
scales obtained by grouping .items together on th§ basis of theix factor 
stnacture vrare homogenous vrtien administered to- a cr.oss-validation sanple, 
except in the case of an; extremely wealt factor with snail factor loadings, 

Subscale Score Ccstparisoas • V . ' 

Differences in the' itean subscale scores among faculty from the 
three programs ^^J^e tested using a nested design multivariate analysis 
•of .variance with programs an^' schcxils nested within program as the in- 
dependent variables and sulicale scores as the dependent variables. The 
level of significance was, set at £<.025 to.maintain an overall level 
of significance at p < .05. The' type . IV ^)proach (Barr , Gooc^night, Sail, 
& Helwig, .1976) r i.e. , a classical regression-approach, was used fc»: / 
der-ivii^ the: sums of -Squares, in the irultivariate analysis of variance ^ 
procedure/ This siipin^ of squares' caiculatioh Tases an unvseighted neans 
procedure whereas the ' Type II , classical experimentol, approach us£?s 
weighted, means establisi^ .by the niimber. of f acuJTty per school.: ; The > 
original intent of tte. stu^ to view each, school, v^aich was the unit 
of , randan sampling, as equal regardless of the nuinber of faculty members, 
who ccns6nted;'t^^^^^^ Thijs Type. IV sums of 

squares, was judged to 1^^^^^^^^ ^' - - ■ - 

tound: f^^^^^ using 

the Pinatl^ tracW cr^^ 
"prpgrm-^^' te with"" program effects' using the 

Pill^i' s ; ixa^^^^^ were found (F [332 ,17971 

: •'■ ' ih-yiew df th? significant .' scdibols within program effect, univ-. . , 
sxialdeilskaiLysis of -v^ subscales was done as f oUow- 

up .f^rodettore. The rneaii^ standard deviations of the sufecalfek^ r 

scores , f or i^,-±Hre^^^f 5 . 

Again itb naihtairi an'^oy^^l ievel of si^if icarice at' E 4' P5 ,. the £ - 
• for .e^ senate. t^t-Was^s yKJol^^fie ^cpected-,' no sig-, .-s.' 

:;.Signlfic£ait^^ ef f ects , f dr^ schoo for sub?^^. 

' aiQ'^u^^iLe; if ^83 i^Sij , . 44 , £ < . 0125 and. 



F [83,4521 = 1.61, £-<.0l25). No significant main effect for schools' 
within program was found on subscale Factor II or on subscale Factor 
IV (F [83,4521 = 1.17, NS and £^[83,452] = 0.S9, NS) . The sum of 
squares table for tJaese analyses is ^presented iri Table -6. *; 

Thus faculty ratings 'did not differ among the three educational 
programs on any siibscale scbce.' Faculty ratings among -the programs 
differed frCm schools within programs on subscale Factor 1 and subscale 
Factor III. Howevair. the faculty ratings did not differ from schools 
withim program oOn siibscale Factxx II and subscale Factor iv; 

■ « • .■ ' . . 

. ■ Table 5. ' ; 

'\ Means and Standard Deviations of Subscale Scares for 

' ° the Three Types of Nursing Progranw (n = 538) ; ' V 



Subscale 



Progisam ' 


I 


' • ^11 \ 


III 


IV ' 


3accalciureate and . 
higher degree 






> 




Mean . 
. SD _ 


77.10 
8.55v 


75.57 
'8.25 


59.30 
_ 11.69 


69.73 , 
13.19 


Associate degree 










< 

^ Mean 
SD 


76.67 
9.06. 


73.57 
10.08 


_ 60.15 
9.54 


69.11 
13.96 


Diplona ■ 










Mean 


76.63 
.9.88 


75.72T 
8.85 


60.21 ' 
11.79 


' 71.14 
12.^93 



For cortpleteness, total score on both instruments . conbined was.^ 
testaa satistically for differences among the mean scores c for faculty 

-from', the three types of educational programs in nursing by use of a 
nested design univariate analysis of variance (£ <.05) . The results of 
this analysis are presented, in Table 7. No. significant main effects for 
program or schools within program were found (F p,83l"= 0.89, NS' arid ■ v - 

' F [83,452] = 1.21, NSj . .Thus there was no difference" among the faculties 
fron'the three types of educatiional programs on' tptal score. . • 
• , ' Because individual difference^-'amqig schools were "not of ijnportance 



Table 6 

•'Multivariate"Analysis of Subscale Total Scores as a Function 
of ftrogram- and Schools Within ^Program 



Subecale 


source SS 


df 


MS 


F 


Maltivariate Analysis . 




program 


8 




1.69 


■ \^ . 


schools within ^ 


162 








program 










" schools within 


,332 




1.29* 


< 


program ^ 










. error 


1,797 






r ■ 


Univariate Analysis 






Factor, I 


progranj 96.67 


2 


48.34 


0.81 




schools within 4960.90 


-83 

. "to 


59.77 


1.44** ', 




,prograin • • 




• 






error « • ' : 18724:29 • 


452 


41.43^ 




Factor *II 


progr^ 1101.47 


2 


550.74 - 


4.09 




schools within 11183.53 


83 


134.74 


1.17 ^ - ' 




program , , . 








- I 


error; ' 52115.56 


452 


115.30 ° 




Factca: III- 


program 285.97 , 


2 


142.99' 


.3.16 


• ■ ■ 


^schools w^^ 3750.02^' 
..^ prbgran ^ ^ / . - ^ ; 


83 


45.18 


1.61** • 




eixor- ' 12654.92 • 


■. 452.; 


28.00 





Factor ,:iy; :p^ . 62;24 2 31.12: 0.89 

V ; ^ ^ s^^ 2905.64 83 ^ 35.00 0.99 ^ 

; . V •program- : . ■ ^ ■' , '■. ' 

error ' 15929,92 452 "35.24 



. .*£ ,:*625: 
**£, .0125. 



to this - study, post hoc corpparisons of tir^e schools within program dif- 
ferences were not performed. Also if thel»st ^ hoc 'coirparisons were made, 
tli,e results woqld probably not be intearpretable except by the faculty - 
ill the particular prograiiB that were ^^^^ 



; " . : Table 7 

Univariate Analysis .of -Total Ratings' Score as a Function of 
. Program and Schools Within Program (n = 538) it 



Source 


V "^ss, . . 


-^df- 


MS 


V f /. 


program : 


1188.28 


2 


. 594 .14/ ' 


0.89 


k:hoDls withiii 
■ program ' 


:55332.11 ' ; 


83- :1 


■666.65 . 


1.20 


error 


25096^32 


452 , 


555.23 





Discussion ' 

"A _ > ^ 

Dimens ionality ^ ' . 

' The first four subscales conclude to be stable across -^^ 
a cross-yaiidation ^sanple f rem the same population. The fifth factor 
' was not stable -on a crossr^alidatidn san4>le^ The 'study • s' results - 
support the petition that tJie corpon^ts (dimsnsions) '^of "a'^criterion 
caT4)etent practice (conpetency) .:can.. be identified by. errpirically a 
groiqping behaviors and traits that are highly coirelated (siml^ly 
rated) . By/Usijig sixih a technique to group cpiterioi elements, the \ " - 
nahare of iiie criterion coanopoients can te 'examined and identified. 
Factot^ analysis provides such an enpirical approach and did yield 
stable factdirs that generalized to a second saiiple from the san^ ^ 

population:. - - ^ . .. . V 

Unquestioiably three of tiie four factors, i.^^ 
Factor III, and Factor IV, were perceived cotponents^of the conceptu^^ 
criterion catpeteht nursHig practice. Factor r represented a perceived 
interpersonal dimension ^ ccpnpetent nursing practice. It primarily . 
inwlved interpersonal relationships with patient -and family members 
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since items reflecting such behaviors had jthe highest leadings on the 
factor. But the factor also included items dealing with interpersonal 
relationships among nursing colleagues and other peers although the. 
loadings of the^e items are smaller." Because Factor I had' the highest 
factor loadings (deanoistrated by,its having the largest sum of squared 
factor loadings) and had the highest percentage of items with a modal 
response rate of 5 (extremely irrportant) , it cw be concluded that 
faculty overall viewed this perceived dimension among those identified • 
as the irost critical to corrpetent nursing* practice. 

Factor III reflected a perceived cognitive-leadership dimension 
of. practice carpetency. This coirpon^t had a slightly lower sum of 
squared factor loadings and had more modal responses of 4 (iitportant) . 
Faculty therefore in general rated this factor as slightly less im- 
portant than Factor I but clearly still viewed this as an iitpartant 
perceived dimsnsion of conpetent practice. 

Factor I and F^^ctor III were slightly correlated; however, it 
seeited apparent from this study that the items forming these factors 
tap two different dimensions and should not be viewed as or, weighted . 
the sane. Th:J3e,two dimensions have not becii clearly identified as 
such in the rationally determined categories established for the ^instru- 
ments discussed previously. Thus this eirpirical approach did yield 
slightly different dimensions than those established by rational 
approaches. 

Both Factor I and Factor III focused on independent nursing 
actions;. Factor IV errphasized dependent niarsing functions, i.e. /those 
activities that involve physicians and the performance of physician 
ordered therapieis as well as those tasks involving routine hospital 
procedures and policies. ?he items corposing this factor enconpassed 
. a mare traditional view of niarsing practice. Clearly faculty as a. . 
v^iole viewed these bdiaviors and traits as relevant to d 
nursing practice since they rated these items as slightly iirportant 
to iiTpcftant. Siit the faculi^. placed less inportance on this factor ^" 
in cotparisoi to Factor I and Factor III/ since the modal response 
ratings. :werfe'low^. - 

Again Factor IV shcjuldbe viewed as different from the other 
.^eviousiy discussed dimensions Also it should be weighted differently* 
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'This perceived ccnponentf of - cotpetent nursing practice has generally 
been identified ty other, than eirpirical approaches as well. 
' ° ..'^ Factor II is vinquestionably ^e least inportant factor in terms' 
of overall faculty ratings. With the lower modal response rate and in 
view Of the raw data ratings, it would seem that this factor did not 
reflect a perceived dljnension of corpetent nursing prp:itice. At best 
these iterag dealt with v y traditional perceptions of nursing reflecting 
behaviors that were incc.isistent with iTiany.:,f acuity menibers '. philosophical 
beliefs. This factor however might well be very sensitive to attitudinal 
ch^ge especiallyjiAien Jj^^ the professional socialization of 

beginning nursing students since the items reflect ccranon misconceptions, 
and ravths about nursing. 

Factor II and Factor IV wei-e slightly correlated. This was not 
surprising sinc^ they were formed by items reflecting traditional 
e:Q)ectations. , 

Since Factor- V was unstable and did not generalize across 

.samples £rcm the same population, it ctuld not be viewed as representing 
a daitension of conpetent nursing practice. The grouping might well be 
an artifact of €he small sample size in relation to the number of item? 

. entered into the factor analysis., With a large sample size, it might 
(SL^SSppeeoc as a factor. 

" Unquestionably there are additional dimensions of nursing 
^cnpetency other than those identified in this study. Even those per- 
ceived dimensions- identified" in this study may not be the only dimensions 
represented by the items cqnposing the two scales, the Cliiiical Nursing 
Rating Scale and the Nurses' Professional Orientation Scale. Again 
with a larger saitple size other dimensions may emerge from either scale. 
But , the factor analytic approach did Yield clear-cut diitensons. This 
, approach also provided data on the correlations of the factors and 
offered scne information on how dimensions and items should be weighted. 
The data suggest that the weighting of the conponents should be different 
since the cotponents as; rated by faculty range ih importance. 

The study's results clearly supported the positioa taken by Astin 
(1964), Dunhette (1963a) , Ghiselli (1956), Ryans (1957), Thomdike (1949), 
and Toops (1944) that successful job perfonnance is multidimensional. 



No single performance criterion could adequately measure the three per- 
ceived dinensions of conpet^uit, nursing practice identified in this study. 

One limitation of a factor analytic approach using coramDn factor 
analysis should be pointed out. Although the factor analysis accounted 
for 55% of the conmDn score variance,, this was only explaining 34% of the 
total score variance. For predictive purposes, i.e., predicting corpe- 
tent nursing practice, this is a concern. 

Homogeneity of Subscales 

The items ..forming the first four subscales as was stated previ- 
ously' did denonstrate internal consistency and they did consistently 
correlate itost highly with the subscale they helped to form on a cross- 
validation sample from the same population. These findings suggested 
that the factors are stable across the same population. This "^supported 
the claim that an empirical factor analytic approach for examining 
ratings of iirportance cn existing instruments is productive and worthy 
of further exploration- in terms of investigating the nature of a ccnpe- 
tency criterion in an applied discipline such as nursing. 

Subscale Score Ccnparisons 

Ttie finding' that there were no significant difference"? for 
program effects aitong the' three faculties teaching in the different 
educational programs in nursing suggested that faculty members in general 
view the items conposing the two scales in terms Of their importance to 
coirpetent nursing "practice similarly. This lent support to the initial 
assunption that this gjroup of nurses as a v*iole was an appropriate pop- ^ . 
ulation to utilize for this type of study. 

The fact that faculty fron the three educational programs did 
not significantly differ ch their mean subscale scares has serious 
iitpncatiais f or the nurs Since faculty across programs, 

have ^similar beliefs about catipetent practice and since it has-been 
dertcnstrated that students take on faculty beliefs as they progress 
through theix nursing program -{Crocker & Brodie, 1974), it becomes more 
clear why graduates from the three types of educaticAal programs may 
perceive competent practice similarly. This helps explain why so much 
cantxoversy^^iste anohg„nurses about the issue of what educational 



preparation should be required for entry level into practice. Certainly 
if the nursing discipline is going to differentiate aitcng types of 
education then the perceptions of what constituted corpetent practice 
for that educational preparation must be clearly differentiated and 
accepted by niurses. The nursing faculty teaching in each type of pro- 
gram nust clearly uiiderstand and believe the iitportance of the diitensions 
underlying corpetent practice for that educational background. 

0 . . . ■■ 

Limitation of this Study 

In interpreting -^dTe-results^ of this study, certain limitations 

should be noted: ' „ " 

1. • Only faculty nenibers were used to form the pool of respondents; 
^, The study started with behaviors from existing scales ' as ■ the 

performance criteria; 

3. Not all dimensional domains of the universe coitpetent nursing 
practice were represented on the two instruments used and; 

" Aj, Perceptions, not actual behavic^s, were rated. 
Also a factor analytic approach is not the only possible approach to 
criteriCTi development. 

° ' ' ' ' 

' Suggestions for Future Research J ■ " 

One iitportant suggestion for future work in this area of criterion 
de'«slqpfr»2nt to further explore the stability of the dixtehsions identi- 
fied as well as the • stability of the dimensions' ihteroorrelations and 
th^ criterion element weights. This could be done by extending the 
saitple to include nursing, administrators and practicing professional . 
nurses. Another need is to extend the^study to include other instru- 
nentSs that are cot^xsed of behaviors believed to be relevant to competent 
nursing, practice. Lists. Of criterion elements composed by such researchers 
as J^en (1960) and Gorham (1962) should be explored to determine the 
underlying dimensions. Interbattery factor analysis (Gorsuch, 1974) may 
well tea technique that jwill deal witii the problem of comparing factors 



acros 



'1 



different instruSients , lists, and sanples. 
Another consideraticai for futtire research in this area is to 
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e3cplore the iterrs con^pcBing each subscale for ciarviiinear relationships 
to the factor (subscale) . Factor analysis is based on the assurtption 
that a linear, relationship exists between the factor and the items 
(elements) loading on the factor. Son^ of the items with lower factor 
loadings nay well have a strong curvilinear relationship to the subscale. 

Another essential area of ., research is to extend the data collec- • 
t±on f ran perceptioais of the inportance of behaviors to actual behaviors 
exhibited by carpetent practicing nurses. Then actual profiles of 
ccnpetent nursing practitioners ccxald be developed. Researchers in the 
nedical field have begun pursuing this approach using factor analytic 
techniques (Price, Taylor, Richards, & Jacobsen, 1964). 

' Sunrnary and Conclusion 

This study examined the nature and dimensionality of the criterion 
cotifjetent" nursing practice through application of a factor analytic 
approach. Three specific aspects were considered (1) the diirensionality 
of the criterion corpetent nursing practice, (2) the honogeneity of the 
dinensians on a cross-validation sanple, and (3) the similarity of 
subscale scores ainang the faculty froti the tljree distinct educational '■. 
prograins for preparing nurses. It was concluded that the factor ana- 
lytic approach allowed the idtaitif ication of dimensions that generalize 
to a second sample from- the sairie pc^lation. The three identified per- 
ceived dinensians of corpetent nursing practice were (1) an interpersonal 
factor, C2) a cognitive-leadership factor, and (3) a dependent nursing 
function factor. The "approach also provided information <3n the inter- 
correlation of dimensions and for the weighting of both the dimensions 
and the criterion elements . No significant difference was detected 
between the itean subscale scores of faculty from -the three nursing 
educational programs. . 

This study deiiK^nstrated the potential of applying, an empirical . 
aEproach using factor analytic techniques to identify the. dimensions - 
' and explore the nature, of the job performance. Using such an approach 
requires deironstrating .that the identified dimensions are stable, i.e., 
generalize to a cross-validation sample. Also in certain situations 
such as this study, it necessitates investigating whether the pool of 
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respondents hold .similar views concerning the importance of the durensions. 
Using existing instruments that measure corpetency can serve as a produc- 
tive beginning step to exploring the nature and dlinensions, ccrrposing a 
conceptual criterion such as coirpetent nursing 'practice. 
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APPENDIX A 

CRARACTERISTICS OF PARTICIPATING NURSING^ FACULTY MEMBERS 

4- 



Dertcgraphic Characteristics Frequency Adjusted Percent 



Age 



20 to 24 years of age 


23 


2 


25 to 29 years of age 


193 


18 


30 to 39 year.^ of age 


353 


33 


40 to 49 years of age 


298 


28 


. 50 to 59 ye^s of age 


167 


16 


.. Over 60 years of age 


37 


, 3 


missing cases 7 






Marital Status 


never narried 


258 


■ 24 ■ 


mariried . . 


667 


63 


widowed 


30 


'3 


divorced/separated 


108 . 


.10 


: missing cases 15 




c 



Race/EthnJbc Group , 


White ^ ■ 


1,021 


96 


Black , . 


<25 


2 


Spanish Suriiained . 


8 


1 . 


Jtonrican Ind^ 


0 


0 


Oriental 


.11 


' 1 


Other 


0 


0 


missing cases 13 






•,:'\ .-V ■ ' •• • , • ., ■ ■ - 


X'/V^rtale 


28 


: "3 ■ 


■ .^feraie 


924 • 


'97 



rmjUssing c 
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.. .EnploVito. -aiaracteristic^ Frequency M justed Percent 



Place of Enplqynenf 



Diplona Program 



^^^a(<calaureatfe. Degree Program 324 30 

Associate Degree Program 344 ,32 



381 . 35 



• RDst-Baccalaureate Pro-am 29 ■ 3 

' missing cases o 

Eirplpyment Status 



employed full time \ 962 . ?? 

errplpyad part time 115 ^ n 

missing cases 1 , 



Type of Position 



Administratos: or Assistant 

Nursing Educator 

Nurse Associate/Practitioner 

(e.g./IPNPr FNPf etc.) 
Other 



missing cases 2 



76 
995 
4 



Wfejor Clinicail Teaching or clinical 
/' Practice Area 



7 

92 
0 



comunity/public Health nursing 
fandly practice 
gerontological nur s ing 
matemal-inf r-'nt health/wonen ' s 

health 
nedical/surgical nursing 
pediatric nursing 
psychiatxic/mental health nursing 
critical care .nursing 
othQC or double practice area 

•missing cases 1 



61 
2 
8 
119 

547 
97 

129 
39 
75 



6 
0 
1 
11- 

51 
9 

12 
4 
7 



ERIC 



Edufiattan-. Characteristics Frequency Adjusted Percent 



Basic Nursing Educational Preparation 



diplcna program. ^ 484 45 

associate degree program ' 51 ^ 5 

bacca^alaureate degree program 538 50 

cotibined degree program "2 . - 0 

missing cases 3. 



Year Graduated from Basic Program 



Program 



prica: to 1930 


0 


1931 to 1940 


30 


, 1941 to 1950 


156 


1951 to" 1960 


284 


1961 to 1970 


359 


1971 to present 


233 


missing cases 1^ 





Highest "Level of Education 



diplona 

associate degree 
baccalaureate -degree In nursing 
baccalaureate degree in«^ other field 
^mast^s degree In nursing 
masters degree in other fieM 
doctorate (e.g., PhiD., Ed.D., 

D.N.SC.) 
double baccalaiareate degrees 
; double"masters degrees 



0 
3 
15 
27 
34 
22 



T 

i 

—L 



22 . 




2 


6 




1 


271 




25 


63 




■ 41 


441 




41 


184 




17 


41- 




4 ' 


12 




fi 

, 1 


23 




2 



itdssing cases 15 
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'APPENDIX B 
EXAMPLES OF ITEMS FRCM TEffi RATING SCALES 
■ Clijiical Nursing Rating Scale 

Dlrectlohs to conplete the rating scale ; The clinical rating scale 
"■ -consists of a list of clinical nursing behaviors. 



Judge the b^iaviors to^be:.. 

\ -5 - E}gnREMELY iMPORTflNT - (vital, without it the patient's well- 
being is ynlikely) 
4 - D^^^ - (should be considered part of effective nursing) 
3 - SLIGHTLY IMPORTaNT - {less iiisxrtant than most behaviors of 

nurses)' " - . 

2 - la^Nli IMPORTfiNT - (is of little value at best) 
1 - UNDESIRaBIiE - (ii"^ undesirable behavior not expected of 
. ' a good niMTse) 

Circle the (XE^'mst ^^prc^riate rating number, for each state- 
manfe, b^sed upon ydS^udgitent of the impor for the 

practicing / prof assionaa nurse in fulfilling her role... Please note that 
you have been asT^ to rate the behaviors for the nurse as a practicing 
^ professional c^ilyi lX):wr mi^ THEIR IMPORTANCE FOR STODENT NyRSES. 
There are no right dr wrong answers. 

.* * W * * * * * * * * * .* * .* 

'* . ■ ■ ■ ' ' 

ii ^ ■ . 

Exanples of it^ from thQ Scale 

12. Shows ability to enphathize .;guid focus oa patient's, 
feelings f creating a trusting and calm relation- 
ship by her presence arid approach; i.e., shows 
understanding in listening to the patient's account 
of v4iy he^^ upset or concerned about seme aspect 
of his condition OjT care. 

15. For her level of\experience, she demonstrates 
flexibility in iiicttif ying hfer patient care plans; 
i.e. is able to deflate from routine practices or 
apply novel soluticn^xto nursing problems as new 
situations arise so as^to provide the cptiitum 
physical, emotional, social, and spiritual climate, 
for the patient. \ 

' 19. Reassures 'patient's family wi^ appropriate infor- 
mation, and shows her personal interest in their 
coicems for the patient, encouraging meaningful 
assistance of the patient, yet allowing him inde- 
'pendence in appropriate self -care. \ 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 
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22. Gives p.r.n. analgesics , oth^ medications, or treat- 
ments v*ien irpst ajprppriate for he patient's condi- 
tion to cpnserve his strength and enhance his therapy 
imking t^hean as palatable and therapeutic as possible 

- for the patiQit. 

23. Punctiois as a cooperative, effective team ineniber in 
nursing, demonstrating high quality nursing care, 
and consistently following through on her responsi- 
bilities; i.e., interpreting her view of the nursing 

^ care plan to other health team members, reporting 
potentially significant facts prcnptly to othet 
health team members regarding patient's symptoms, 
etc., or being available to implement the work of 
" the rest of the team when needed. 



12 3 4^5 



1 2 3 4 5 




/ 



V 




@ ali rights reserved. May not be reptoduced or distrihuted 
without permission of author. ' 
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" ' Professioial Trait Ratijig Scale 

-Instr uctions t This questionnaire is carpeted of a list of descriptive • 
— — characteristics and betiaviors^ .You . are asked to judge 'how essential 

each trait is for .the practicing ^ professional nurse in fulfilling 
. ; her role. Please note that you have been asked to xate. these traits 
' ' ^ for- the nurse as a practicing professional dnly. DO^NOT RATE IHEIR 

iudge thp trait to be: , - 

5 EXTREtffiLY XMeQigANT - (vital> without it the patient's \jell- 
' being^^is unlikely) ' 

...4— iMPQBgaNT; ;T^ (should.be considered part ofi.effective nursang) 
3 SLIGHTLY: IMTO ( less litpbrtant than' most behaviors of 

. ^^■-'■^ nurses) . ' ■ I 
2 -■ MOT AT ALL IMPORjANT - (is of little value at best) 
' 1 > 4 t^^IRRBLE '/^ , (is an undesirable behavior not expa:ted of 
- ;a^ good: nurse).- 

f There are no right or wrong ans\rers for these items. Judge each 
one in accordance with your own personal opinion. 

Exanples of Items .from' the Scale Fac'ax 

1 . Quickly rises to the defense of medical and hos- 
pital practices vihen they are criticized by layman. 

14. Never corplains about receiving a patient care 
assignment. . ^ 

19. Always present a neat appearance while on duty. 

26. Can learn a new procedure quickly. 

31. Gets along well with physicians. 

41. Knows the scientific reasons for her actions in 1 2 3 4 5 HI 
nursing. 

U. Skilled in recognizing and using signs of non- 12 3 4 5 III 

verbal ccnrounication. 



12 3 4 5 II 

1 2 3 45 II 

12 3 4 5 IV 

12 3 4 5 IV 

12 3 4 5 IV 



45. ' Always tries to be smiling and cheerful vAien 
' entering a patient's room. 



12 3 4 5 II 
12 3 4 5 III 



47. Understands underlying emotional causes of 
patient behavior. . 

, 4 . . ■ ■ , . 

51. Knows how .to^ecure., the coc$5eration of co-workers. 1 2 3 4 5 Ii; 

; :vry,;:, . ■ - ..-.7;, , . . , ■ ; 

• -0, all rights reserved. May not, be reproduced or distributed without 
pennission.. of author ; . I . , ' 
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